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1. INTRODUCTION 

This paper presents an iterative technique for solving optimization problems using an edge- 
preserving regularization (EPR) objective function. In general, two equations explain impulse noise. The first 
equation uses an adaptive median filter (AMF) [1] to detect pixels that may be contaminated. Let X be the 
true picture and A = {1,2,3,..... M} x {1,2,3,..... N} be its index set. Let N C A be the indices of the first 


phase noise pixels. Let Pj be the set of four closest neighbors of the pixel at (i,j) € A, y;,; be the observed 


pixel value at (i,j), and uj; = [ be a lexicographically ordered column vector of length c. N has c 


Hila jnen 
components. This is done by reducing the following functional: 


fa) = Yajyen [lu = yij| + F(2 % Sip S?)|. (1) 


where f£ is. the regularization parameter, and Siy =2 Lonnyer; jae Pa (ui; — Yan bey = 
Yomnyer;j0w ga(Uij —Ymn). The dg = Va + x*,a > 0 is an example of an edge-preserving potential. In 


reality, the non-smooth data-fitting term is unnecessary in the second phase, when only noisy pixels are 
restored, Yu et al. [2]. Thus, several optimization techniques may be extended to minimize the smooth edge- 
preserving regularization (EPR) functional: 


fa(u) = Lanenl2 x Si; + Si 2) 
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Image restoration uses conjugate gradients, image restoration problems are expressed as: 
Minf(u) , ue R” (3) 


where f:R” > R is smooth function, Gilbert and Nocedal [3]. A general conjugate gradient algorithm 
generates a sequence of iterates by the rule: 


Xeo1 = X_ + Ady (4) 


where the step size @, is positive and the directions d, are computed using the updating formula: 


Aa = —Gx+1 + Bede (5) 


which f; is a scalar known as the conjugate gradient parameter. Different choices of B, lead to various 
conjugate gradient methods, Andrei [4]. In this paper, we focus our attention on well-known method such as 
Fletcher and Reeves, [5] given by: 


T 
FR — 9k4+19k+1 6 
B IL IK (6) 


it is well known that the FR possess nice convergence properties. In the past decades, a variety of conjugate 
gradient methods are developed. There are some well known conjugate gradient methods, such as [6]-[10]. 
Other nonlinear conjugate gradient methods and their global convergence can be found in [11]. We can get 
the step-size a, using the exact line research: 


T 
_ ~IKak 
my = re (7) 


see, [12]. Usually, in (2), the steplength a, is computed using the Wolfe line search conditions: 


f (Xe + Ody) S f (Xe) + Sarge dy (8) 
dG (Xp + Andy) =O dE Ix (9) 


where 0 <6 <o <1, Wolfe [13], [14]. During the last decade, much effort has been devoted to develop 
new conjugate gradient methods which not only possess strong convergence properties but are also 
computationally superior to the classical methods. The most typical feature of conjugate gradient methods is 
conjugacy, namely, the search directions generated by (3) should possess the following conjugacy condition: 


diss Qdy = 0 (10) 


researchers focus their attention on conjugacy condition. One of the remarkable results is obtained in 
conjugate gradient methods. For a good reference for studies describing the latest CG coefficients with 
important result and various modifications from f;,, Xue et al. [1]. For further references on the optimization 
methods, please refer to [15]-[18]. 

Using the conjugacy condition , we are now ready to give some new formulas of nonlinear 
conjugate gradient methods. Global convergence of these formulas have been established. Finally, some of 
the numerical results have been reported, which show the effectiveness of the new formula. 


2. NEW CONJUGATE GRADIENT COEFFICIENT 
In our paper, By adopting some idea that in the literature [19]. We first consider the second order 
Taylor series of f (x) as (11). 


1 
fu) = f Uesr) + Oke U — Us) + 3 (U = Uns)” QU) (U = Uxs1) (11) 
Finding the derivative yields: 


roi = Gx + Mug) SE (12) 


The parameter, (,, in the linear conjugate gradient method is given by: 
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T 
_ Ik4+19Sk 
B= at og (13) 


where Q is Hessian matrix and where f, is satisfies the conjugacy condition, Hassan and Sulaiman [19]. 
Now, we shall consider another expression of the denominator d7 Qs;,,. Using (11) and (7) in (11), we obtain: 


SEQ (Ug) Sp = 2/35LV~ + 2/3 fe — fer) (14) 
which implies that: 
dj Q(Ug) Sx = 2/3d Ve + 2/3 Se — fiers) / Ce (15) 


from this we advance formula, 


Tha 1Vk 
= 16 
By 2/34 fp ye+2/3(F ef ke41)/ Ok Ge) 


since f is quadratic model by using exact line search, then (16) reduces to: 


9 rts Il? 
= 17 
Be 2/34 fp ye+2/3(F ef ke41)/ Ok ay) 
and 
lg reeall? 
= 18 
Br =2/3d pg e+2/3(F kf k41)/ Ak Us) 
and 


poe geal? (19) 
Kk  2/3g.9%+2/3(F ef esa) /k 


our formula, so-called BA1, BA2 and BA3. They show that the new method globally convergent for general 
functions under some proper conditions. Below we present the BA algorithms: 
- Stage 1 : Set k = 1, thend,; = —g, and select u,. 
- Stage 2 : Test for Continuation of Iterations. 
- Stage 3 : Calculate the step length by using Wolfe line search (5) and (6). 
- Stage 4: Compute d;,,, using (5). 
7 Stage 5 : Compute u;,.4, using (4). 
“ Stage 6 : Set k=k+1, and go to Step 1. 
Theorem (2.2) 
The search direction defined by (3) with (17)-(19) satisfy: 


dh 1Dk+1 < 0 and dhsi1Gk+1 = Bd Dx (20) 


Proof : 
Clearly by (3), if k = 0 then g3 dy = —||goll? holds, let d?.g, < 0 for all k. Multiplying both sides 
of (3) with gf41, we get: 


dhi1Gk+1 = —Gh+iGeer + Bid Suvi 
—Bi(2/3d,V~ + 2/3 Fe — fics) / Ae) + Be dh Ge +1 (21) 


From (21), we obtain: 


dies 1Girr1 = Bele Gurr — (2/3dpy_ + 2/3 (fe -— fert)/ex)] (22) 
also, by using (17) and (21) we get: 
dis 19k+1 = Belk Ir (23) 


by the dig, < Oand (23), we can write: 


desi 9k+1 <0 (24) 
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hence d2449ka1 <0 and d0449x41 = Bedkg, holds, which completes the proof. Similarly, other methods 
can be proved. 


3. CONVERGENCE ANALYSIS 

In the above section, we have proved that the new methods has decsent property property that is 
independent of the line search and the function. convexity. In this section, we will make use of this property 
to establish the global convergence for the new methods using a variety of line searches. Suppose that the 
objective function satisfies the following assumption. 
Assumptions: 
I) The level set. Q = {u € R"/f(u) S f(u,)}, is bounded. 


II) Gradient is Lipschitz continuous, that is, for L > 0: 
llg(P) — gO) SL ||P—OlL, vP,OEA (25) 


for more details see [20]-[22]. 
By having these assumptions, Zoutendjik [23] has proven the following Lemma. 
Lemma (3.1): 
Suppose Assumption are satisfied. In any iteration method if @, is satisfied Wolfe line search, then: 


wo (Geax)? 
Liat Tae < 


Proof : For see Sulaiman and Hassan [24] and Zhang and Xu [25]. 
Theorem (3.2): 
Suppose that Assumption and Lemma 1 holds. Then, 


lim inf \lgxll = 0 (27) 
Proof : 


By induction, let that (27) is not true. Suppose that there exists c, > 0 such that ||g,|| = c, for all 
k En. Squaring both sides of (8), we get: 


diy ll? te Dies ll? + 2di+1Ie+1 = (Bx) Idyll? (28) 


using (23), yields: 


d 2 (dhs 9k41)? d 2_ 2qT = 2 29 
dies all? = Cg P* dy I? — 2dF dus — lhgieall (29) 


divide by (29) by (dh419x41)*, we get: 


dies all? Idxll? l I? 2 
k+1 a k Gk+1 (30) 


(apy 19n+1)%  (dhgx)? (hy 9e+1)? thy 941 


using (3), (17), and (30), we obtain: 


lldxsall? Idyll? ll ll 1 1 dx ll? 1 
r k+1 7 < 7 > wok + 7 > < as 7 + 7 (31) 
(44 9k+1) (dy. 9k) (dy449k+1) ll9x+all I9k-+all (dy. 9k) 9x+all 
hence, 
dies ll? k+1_ 1 
— en yt 32 
(dhs 19k41)? 1 gill? (32) 
therefore, 
d 2 k+1 
llde+all 2 (33) 


(ab 4 9k+1)” cP 
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from (33), we obtain: 


oo (kan)? _ 
deat Yagi? © ey 


based on Lemma 1, we get fim inf |lgx|| = 0 holds. 


4. NUMERICAL RESULTS 

The numerical findings in this section indicate the effectiveness of New in the reduction of salt-and- 
pepper impulse noise. New and FR methods are tested in our trials. MATLAB 12017a is used to write and 
execute all of the programs. The following are the stopping criteria for both methods (35). 


POR D! < 10-4 and [If uy )Il < 10-*(1 + IF Cu) (35) 
Lena, House, Cameraman, and Elaine make up the test photos. PSNR (peak signal-to-noise ratio) is 
a quantitative metric that may be used to evaluate the quality of the restoration process: 


2552 


PSNR = 10log,) ~—-—_— (36) 


» fay .—ay* .)2 
Man i,j Ui j-Up) 


in this case, uj ; and u; ; represent the restored and original image's pixel values, respectively. 

The number of iterations (NI) and the number of function evaluations (NF) needed for the whole 
denoising process, as well as the PSNR of the recovered picture, are reported in this paper. We can observe 
from Table 1 that the New technique is much quicker than the FR method for the vast majority of the test 
photographs. Furthermore, we see that the PSNR values obtained by the New and FR methods are fairly 
close. Conclusion. Table 1 shows that the suggested methods outperform the FR approach in terms of number 
of iterations, function evaluations, and peak signal to noise ratio when it comes to eliminating impulse noise 
from photos. 

Figures 1-4 show the obtained results by denoised images. Figures (al), (a2), (a3) and (a4) are the 
images corrupted with 70% salt-and-pepper noise; Figures (b1), (b2), (b3) and (b4) are results of FR method; 
Figures (cl), (c2), (c3) and (c4) are results of the BA1 method; Figures (d1), (d2), (d3) and (d4) are results of 
the BA2 method; and Figures (e1), (e2), (e3) and (e4) are results of the BA3 method. 


al 


Figure 1. Demonstrates the results of algorithms: (al) denoised images with 70% salt-and-pepper noise, (b1) 
FR method, (cl) BA1 method, (d1) BA2 method and (e1) BA3 method of 256 * 256 Lena images 


avzstea8 


a2 b2 c2 d2 


Figure 2. Demonstrates the results of algorithms: (a2) denoised images with 70% salt-and-pepper noise, (b2) 
FR method, (c2) BAI method, (d2) BA2 method and (e2) BA3 method of 256 * 256 House image 
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a3 


Figure 3. Demonstrates the results of algorithms: (a3) denoised images with 70% salt-and-pepper noise, (b3) 


FR method, (c3) BAI method, (d3) BA2 method and (e3) BA3 method of 256 * 256 Elaine image 


a4 


Figure 4. Demonstrates the results of algorithms: (a4) denoised images with 70% salt-and-pepper noise, (b4) 
FR method, (c4) BA1 method, (d4) BA2 method and (e4) BA3 method of 256 * 256 Cameraman image 


Tablel. Numerical results of FR, BA1, BA2 and BA3 algorithms 


Image Noise level r FR-Method BA1-Method BA2-Method BA3-Method 
(%) NI NF PSNR NI NF PSNR NI NEF PSNR NI NEF PSNR 
(dB) (dB) (dB) (dB) 
Le 50 82-153 30.5529 42 89 30.7873 42 91 30.4787 44 93 30.6782 
70 81 155 27.4824 45 94 27.391 40 80 27.3022 41 81 27.3242 
90 108 211 22.8583 54-109 23.0297 84 167 22.6043 49 94 23.0253 
Ho 50 52 53 30.6845 28 57 34.8651 32 «67 34.7529 3368 34.7004 
70 63 116 31.2564 37 71 30.9231 37.73 31.2538 32 63 31.1076 
90 111 214 25.287 48 99 25.1515 69 137 24.9917 47 95 25.1155 
El 50 35 36 33.9129 23 43 33.895 21 40 33.875 25 47 33.8553 
70 38 39 31.864 300 56 31.8106 32 «61 31.9086 29 «53 31.8757 
90 65 114 28.2019 38 72 28.1511 53. 103 28.2248 39 «72 28.1069 
e512 50 59 87 35.5359 26 56 35.3508 23 «49 35.7124 30.— 61 35.4487 
70 78 142 30.6259 37 76 30.6036 49 100 30.6724 36 0=—72 30.7193 
90 121 236 24.3962 52. 109 24.9562 70 141 24.7639 52. 109 24.9182 
5. CONCLUSIONS 


In this research, we offer novel CG approaches for minimizing the smooth regularization functional 


for impulse noise reduction, which we call smooth regularization functions. The parameters of the new 
technique are generated from a quadratic model, which is described in this paper. The numerical findings 
demonstrate that the novel technique has a low computing cost and is effective at solving signal processing 
difficulties. 
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